Approximating Markov chains and V -geometric ergodicity via weak perturbation theory

نویسنده

  • James LEDOUX
چکیده

Let P be a Markov kernel on a measurable space X and let V : X→[1,+∞). This paper provides explicit connections between the V -geometric ergodicity of P and that of finite-rank nonnegative sub-Markov kernels P̂k approximating P . A special attention is paid to obtain an efficient way to specify the convergence rate for P from that of P̂k and conversely. Furthermore, explicit bounds are obtained for the total variation distance between the P -invariant probability measure and the P̂k-invariant positive measure. The proofs are based on the Keller-Liverani perturbation theorem which requires an accurate control of the essential spectral radius of P on usual weighted supremum spaces. Such computable bounds are derived in terms of standard drift conditions. Our spectral procedure to estimate both the convergence rate and the invariant probability measure of P is applied to truncation of discrete Markov kernels on X := N. AMS subject classification : 60J10; 47B07

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov‎ ‎processes

‎In the present paper we investigate the $L_1$-weak ergodicity of‎ ‎nonhomogeneous continuous-time Markov processes with general state‎ ‎spaces‎. ‎We provide a necessary and sufficient condition for such‎ ‎processes to satisfy the $L_1$-weak ergodicity‎. ‎Moreover‎, ‎we apply‎ ‎the obtained results to establish $L_1$-weak ergodicity of quadratic‎ ‎stochastic processes‎.

متن کامل

Perturbation theory for Markov chains via Wasserstein distance

Perturbation theory for Markov chains addresses the question of how small differences in the transition probabilities of Markov chains are reflected in differences between their distributions. We prove powerful and flexible bounds on the distance of the nth step distributions of two Markov chains when one of them satisfies a Wasserstein ergodicity condition. Our work is motivated by the recent ...

متن کامل

A Perturbation Theory for Ergodic Properties of Markov Chains

Perturbations to Markov chains and Markov processes are considered. The unperturbed problem is assumed to be geometrically er-godic in the sense usually established through use of Foster-Lyapunov drift conditions. The perturbations are assumed to be uniform, in a weak sense, on bounded time intervals. The long-time behaviour of the perturbed chain is studied. Applications are given to numerical...

متن کامل

Perturbation Analysis for Denumerable Markov Chains with Application to Queueing Models

We study the parametric perturbation of Markov chains with denumerable state spaces. We consider both regular and singular perturbations. By the latter wemean that transition probabilities of aMarkov chain, with several ergodic classes, are perturbed such that (rare) transitions among the different ergodic classes of the unperturbed chain are allowed. Singularly perturbed Markov chains have bee...

متن کامل

Geometric Ergodicity and Hybrid Markov Chains

Various notions of geometric ergodicity for Markov chains on general state spaces exist. In this paper, we review certain relations and implications among them. We then apply these results to a collection of chains commonly used in Markov chain Monte Carlo simulation algorithms, the so-called hybrid chains. We prove that under certain conditions, a hybrid chain will “inherit” the geometric ergo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013